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Abstract — The Grassmann manifold Qn,p (L) is the set of all 
p-dimensional planes (through the origin) in the n-dimensional 
Euclidean space L", where L is either R or C. This paper 
considers an unequal dimensional quantization in which a source 
in G,i.p (L) is quantized through a code in t/„,q (L), where p and 
q are not necessarily the same. It is different from most works 
in literature where p = q. The analysis for unequal dimensional 
quantization is based on the volume of a metric ball in Qn.p (L) 
whose center is in Q„,q (L). Our chief result is a closed-form 
formula for the volume of a metric ball when the radius is 
sufficiently small. This volume formula holds for Grassmann 
manifolds with arbitrary n, p, q and L, while previous results 
pertained only to some special cases. Based on this volume for- 
mula, several bounds are derived for the rate distortion tradeoff 
assuming the quantization rate is sufficiently high. The lower and 
upper bounds on the distortion rate function are asymptotically 
identical, and so precisely quantify the asymptotic rate distortion 
tradeoff. We also show that random codes are asymptotically 
optimal in the sense that they achieve the minimum achievable 
distortion with probability one as n and the code rate approach 
infinity linearly. 

Finally, we discuss some applications of the derived results 
to communication theory. A geometric interpretation in the 
Grassmann manifold is developed for capacity calculation of 
additive white Gaussian noise channel. Further, the derived 
distortion rate function is beneficial to characterizing the effect of 
beamforming matrix selection in multi-antenna communications. 

Index Terms — the Grassmann manifold, rate distortion trade- 
off, channel capacity, beamforming, MIMO communications 



I. Introduction 

The Grassmann manifold Gn,p (L) is the set of all p- 
dimensional planes (through the origin) in the n-dimensional 
Euclidean space L", where L is either R or C. It forms a com- 
pact Riemann manifold of real dimension (3p {n — p), where 
(3=1 when L = R and {3 = 2 when L = C. The Grassmann 
manifold is a useful analysis tool for multi-antenna communi- 
cations (also known as multiple-input multiple-output (MIMO) 
communication systems). The capacity of non-coherent MIMO 
systems at high signal-to-noise ratio (SNR) region was derived 
by analysis in the Grassmann manifold [2]. The well known 
spherical codes for MIMO systems can be viewed as codes 
in the Grassmann manifold [3]. Further, for coherent MIMO 
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in [1] to the unequal dimensional case. 



systems with finite rate feedback, the quantization of eigen- 
channel vectors is related to the quantization on the Grassmann 
manifold [4]-[8]. 

This paper studies unequal dimensional quantization on the 
Grassmann manifold. Roughly speaking, a quantization is a 
representation of a source: it maps an element in Qn,p (L) (the 
source) into a subset C C Gn,q (L), which is often discrete 
and referred to as a code. While it is traditionally assumed 
that p = q [1], [9]-[ll], we are interested in a more general 
case where p may not necessarily equal to q; thus the term 
unequal dimensional quantization. The performance limit of 
quantization is given by the so called rate distortion tradeoff. 
Let the source be randomly distributed and define a distortion 
metric between elements in Q„.p (L) and Qn^q (L). The rate 
distortion tradeoff is described by the minimum average dis- 
tortion achievable for a given code size, or equivalently the 
minimum code size required to achieve a particular average 
distortion. This paper will quantify the rate distortion tradeoff 
for unequal dimensional quantization. 

This paper appears to be the first to explore unequal dimen- 
sional quantization systematically. According to the authors' 
knowledge, works in literature assume that p = q: The Rankin 
bound in Qn.p (R) is obtained in [9] when the code size is 
large. When p is fixed and n is asymptotically large, approx- 
imations to the Gilbert- Varshamov and Hamming bounds on 
Qn.p (]L) are drived by Laplace method in [10] and by volume 
estimates in [11], [12]. The distortion rate ttadeoff for the 
p = I case is quantified in [4], [5] by direct volume calculation 
and in [7] using high resolution quantization theory. Our paper 
[1] characterizes the tradeoff for the general p case when 
quantization rate is sufficiently high. While the p = q case has 
been extensively studied, unequal dimensional quantization 
does arise in some multi-antenna communication systems, see 
[8] for an example. It is thus worthwhile to go beyond the 
p = q case. 

The main contribution of this paper is to derive a closed- 
form formula for the volume of a small ball in the Grassmann 
manifold and then accurately quantify the rate distortion 
tradeoff accordingly. Specifically: 

1) An explicit volume formula for a metric ball is derived 
for arbitrary n, p, q and L when the radius S is 
sufficiently small. Useful lower and upper bounds on 
the volume are also presented. 

2) Tight lower and upper bounds are derived for the rate 
distortion tradeoff. Further, fix p and q but let n and 
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the code rate (logarithm of the code size) approach 
infinity Unearly. The lower and upper bounds are in fact 
asymptotically identical, and so precisely quantify the 
asymptotic rate distortion tradeoff. We also show that 
random codes are asymptotically optimal in the sense 
that they achieve the minimum achievable distortion 
with probability one in this asymptotic region. 

Finally, some applications of the derived results to communi- 
cation theory are presented. We show that data transmission in 
additive white Gaussian noise (AWGN) channel is essentially 
communication on the Grassmann manifold. A geometric in- 
terpretation for AWGN channel is developed in the Grassmann 
manifold accordingly. Moreover, the beamforming matrix se- 
lection in a MIMO system is closely related to quantization 
on the Grassmann manifold. The results for the distortion 
rate tradeoff are therefore helpful to characterize the effect 
of beamforming matrix selection. 

II. Preliminaries 

For the sake of applications [4]-[6], the projection Frobe- 
nius metric (chordal distance) and the invariant measure on 
the Grassmann manifold are employed throughout this paper. 
Without loss of generality, we assume that p < q. For any 
two planes P G Gn,p (L) and Q g Gn,q (L), we define the 
principle angles and the chordal distance between P and Q 
as follows. Let pi e P and qi G Q be the unit vectors such 



optimal quantization to minimize the distortion is given by 
q (P) = arg min dc {P, Q) . The corresponding distortion is 



D{C) ^ Ep 



min dl [P, Q) 

Qec 



The rate distortion tradeoff can be described by the distortion 
rate function: the infimum achievable distortion given a code 
size K 

D* (K) = inf D (C) , (2) 

C:\C\=K 

or the rate distortion function: the minimum required code 
size to achieve a given distortion D 

K* (D) = inf ICI . (3) 

D{C)<D 

III. Metric Balls in the Grassmann Manifold 

This section derives an explicit volume formula for a metric 
ball B (S) in the Grassmann manifold. It is the essential tool 
to quantify the rate distortion tradeoff. 

The volume of a ball can be expressed as a multivariate 
integral. Assume the invariant measure fi and the chordal 
distance dc- For any given P e Qn^p (L) and Q e Qn,q (L), 
define 

Bp (s) = {g e gn,g (L) : 4 [p, q) < s} 



that 



is maximal. Inductively, let e P and e Q and 



be the unit vectors such that pjpj = and q^q, = for all = ^ Q-,p (L) : 4 (P, O) < s] 



then defined as — arccos 
the chordal distance between 



is maximal. The principle angles are 

p|qi for i = 1, • • • ,p [9], and 
P and Q is then given by 



rfc (P, Q) 
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It has been shown that ^{Bp{5)) = ^{Bq{5)) and the 
value is independent of the choice of the center [13]. For 
convenience, we denote Bp {5) and Bq [6) by B {5) without 
distinguishing them. Then, the volume of a metric ball B {5) 
is given by 



The invariant measure /i on Qn,p (L) is the Haar measure 
on tJn,]9 (L). Let O {n) and U [n) be the groups of n x ri 
orthogonal and unitary matrices respectively. Let A, B G 
O (n) when L = M, or A, B e C/ (n) when L C. For 
any measurable set M C Qn,p (L) and arbitrary A and B, /i 
satisfies 

^i{AM) = ii{M)^ tiiMB). 

The invariant measure defines the uniform/isotropic distribu- 
tion on Qn.p (L) [13]. 

This paper addresses an unequal dimensional quantization 
problem. Let C be a finite size discrete subset of Qn,q (L) (also 
known as a code). An unequal dimensional quantization is a 
mapping from the Qn^p (L) to the set C, q : Qn,p (L) C, 
where p and q are not necessarily the same integer Without 
loss of generality, we assume p < q. We are interested in 
quantifying the rate distortion tradeoff. Assume that a source 
P € Gn,p (L) is isotropically distributed. Define the distortion 
measure as the square of the chordal distance d^ (■,■)■ Then 
the distortion associated with a quantization q is defined as 
D = Ep [dl (P, q (P))] . For a given code C C Gn.q (L), the 
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where l< 0i<^, ■■■,!< Op <^ are the principle angles 
and the differential form d^g is the joint density of the di's 
[13], [14]. 

Theorem [T] computes the multivariate integral (HI into a 
simple exponential form. 

Theorem 1: When 5 < I, the volume of a metric ball B (5) 
is given by 



where 

/3 = 



(5) 
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if L 



1 TTP r(|(«-»+i)) 

r(fp(n-g) + l) ii»=l ?(f(^^r-^ 

if p + q < n 
1 T-in-q r(|(«-»+i)) 

r(|p(n-9) + l) r(|(n-p-i+l)) 

if p + q > n 



(6) 
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and 



Volume of small balls in the Grassmann manifold (n,p,q|i) 



.(1) 



|p {n ~ q) 



§p{n-q) + l 



(7) 



The proof is given in the journal version of this paper [15] 
There are two cases where the volume formula becomes 
exact. 

Corollary 1: When (5 < 1, in either of the following two 
cases, 

1 ) L = C and q = p; 

2) L = M and g p + 1, 

the volume of a metric ball B (S) is exactly 

where Cn,p,q,p is defined in 

We also have the general bounds: 

Corollary 2: Assume (5 < 1. If L = M and p = q , the 
volume of B (S) is bounded by 



For all other cases. 



iPiq-p+l)~p 



V ^ J ^^^p^q^p^ 

Proof: Corollary [T] and |2] follow the proof of Theorem [T| 
by tracking the higher order terms. ■ 

Theorem [T] is of course consistent with the previous results 
in [1], [4], [10], which pertain to special choices of n, p, q or 
L. Importantly though. Theorem [T] is distinct in that it holds 
for arbitrary n, p, q and L. 

For engineering purposes, it is often satisfactory to approx- 
imate the volume of a metric ball B {S) by Cn,p,q,f35^^''^^'^'' 
when 5 < 1. Fig. [T] compares the simulated volume (|4|l and 
the approximation Cn,p,q,f3S^P^^^^'^'> . Since it is often difficult to 
directly evaluate the multivariate integral in (|4|, we simulate 
^ (B {S)) = Pr {P G gn,p (L) : 4 [p, O) < s] by fixing 

Q and generating isotropically distributed P. The simulation 
results show that our volume approximation Cn,p,q,i3S^'P^'^~'^'> 
(solid lines) is close to the simulated volume (circles) when 
S < 1. We also compare our approximation with Barg- 
Nogin approximation developed in [10]. There, an volume 
approximation is derived by Laplace method and 

is only valid for the p = q ^ n. Simulations show that the 
simulated volume and Barg-Nogin approximation (dash lines) 
may not be of the same order while our approximation is much 
more accurate. 

IV. Quantization Bounds 

This section quantifies the rate distortion tradeoff for the 
unequal dimensional quantization problem. The results hold 
for arbitrary n, p, q and L. 

Recall the distortion rate function defined in A lower 
bound and an upper bound are derived. 

Theorem 2: When K is sufficiently large 
({cn,p,q,pK)^ i^p("-i'} < 1 necessarily), the distortion 
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Fig. 1. Volume of small balls in the Grassmann manifold. The integers 
besides curves are, from left to right, n, p, q, and f3 respectively. 



rate function is bounded as in 

Pp {n ~ q) 



(3p {n 



2T 



icn,p^q.pK)-M^ (1 + (1)) < D* (K) 



< 



( 2 \ 
\pp{n-q) J 



Pp {n - q) 



{Cn,p,q,[3K) ''^1^(1+0(1)). 



(8) 

Remark 1: For engineering purposes, the main order terms 
in (O are usually accurate enough to characterize the distortion 
rate function. The details of the (l + o(l)) correction are 
spelled out in the journal version of this paper [15]. 

The proof is provided in the journal version of this paper 
[15]. We sketch it as follows. 

The lower bound is proved by a sphere covering argument. 
The key is to construct an ideal quantizer, which may not 
exist, to minimize the distortion. Suppose that there exists K 
metric balls of the same radius 6q packing and covering the 
whole Qn^p (L) at the same time. Then the quantizer which 
maps each of those balls into its center Q G Qn^q (L) gives 
the minimum distortion among all quantizers. Of course such 
an ideal covering may not exist. Therefore, the corresponding 
distortion may not be achievable. It is only a lower bound on 
the distortion rate function. 

Next the upper bound is obtained by calculating the average 
distortion of random codes. The basic idea is that the distortion 
of any particular code is an upper bound of the distortion rate 
function and so is the average distortion of random codes. A 
random code Ciand = {Qii ■ ■ ■ , Qk} is generated by drawing 
the codewords Qi's independently from the isotropic distribu- 
tion on Qn^q (L). The average distortion of random codes is 
given by Ec,j,„d [D (Crand)]- By extreme order statistics, see for 
example [16], the calculation of Ec,^,^ [D (Crand)] is directly 
related to the volume (|4]i. Based on our volume formula (|5]l, 
the asymptotic value of Ec^^^^^ [D (Crand)] is computed and 
thus the upper bound is obtained for large K. 

As the dual part of the distortion rate tradeoff, lower and 
upper bounds are constructed for the rate distortion function. 
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Corollary 3: When the required distortion D is sufficiently 
small (D < 1 necessarily), the rate distortion function satisfies 
the following bounds, 



distortion rate function for G (C) 



1 



/3p {n - q) 



■D 



C„,p,?,/3 \ 2r f TTT^) 

^ - ;(3p{n-q) + 2 



(l + o(l))<X* {D) 



Cn,p,q,l3 \ f3p{n- q) 



D 



(l + o(l)). 



(9) 

It is interesting to observe that the lower and upper bounds 
are asymptotically the same. As a result, the asymptotic rate 
distortion tradeoff is exactly quantified. 

Theorem 3: Suppose that p and q are fixed. Let n and the 
code rate log2 K approach infinity linearly with ^ f. 
If the normalized code rate f is sufficiently large (p2^^^ < 1 
necessarily), then 

lim D* (K) ^ p2-^\ 

On the other hand, if the required distortion D is sufficiently 
small {D < 1 necessarily), then the minimum code size 
required to achieve the distortion D satisfies 



lim 



log^ K*{D) (3p 



(10) 



n 2 °^\Dj 

Remark 2: That the (1 + o(l)) multiplicative errors in ([Sj 

and (|9|l disappear is the content of [15]. We omit the corre- 
sponding details due to the space limitation. 

Fig. |2] compares the simulated distortion rate function (the 
plus markers) with its lower bound (the dashed lines) and 
upper bound (the solid lines) in ([8]). To simulate the distortion 
rate function, we use the max-min criterion to design codes 
and the employ the corresponding distortion as an estimate of 
the distortion rate function. Simulation results show that the 
bounds in ([8]l hold for large K. When K is relatively small, the 
formula (O can serve as good approximations to the distortion 
rate function as well. Furthermore, we compare our bounds 
with the approximation (the "x" markers) derived in [17], 
which is partly based on Barg-Nogin volume approximation. 
Simulations show that the approximation in [17] is neither an 
upper bound nor a lower bound. It works for the case that 
n = 10 and p = 2 but doesn't work when n < 8 and p ~ 2. 
As a comparison, our bounds (O hold for arbitrary n and p. 

While the asymptotic rate distortion tradeoff is precisely 
quantified, the next question could be how to achieve it. 
Same to many cases in information theory, random codes are 
asymptotically optimal with probability one. 

Corollary 4: Consider unequal dimensional quantization 
from Qn.p (L) to t/„^g (L). Let dand C t/„,g (L) be a code 
randomly generated from the isotropic distribution and with 
size K. Fix p and q. Let ti, logj K ^ oo with ^'^ 
f G M+. If the normalized code rate r is sufficiently large 
{p2~~Pv'^ < 1 necessarily), then for Ve > 0, 



lim Pr (Crand) > p2-^3?'' 4 
The proof is omitted due to the space limitation. 
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Fig. 2. Bounds on the distortion rate function 

V. Applications to Communication Theory 
A. Channel Capacity of AWGN Channel 

Although the capacity of AWGN channel is well known, 
it is interesting to re-calculate it from an interpretation in the 
Grassmann manifold. 

The signal transmission model for an AWGN channel is 
that Y = X + W, where Y, X, W e L" are the received 
signal, the transmitted signal and the additive Gaussian noise 
respectively, and L is either R or C. Assume that X and W 
are Gaussian vectors with zero mean and covariance matrices 



E 



XX 



I and E 



WW 



: (7^ I respectively. For any 
e > 0, construct a random codebook Sx = {Xi, • • • ,Xx} 
with ^ and i ||Xfc||^ e (1 - 2e, 1 - e) for all k = 

1, . " 



.K. 

Now suppose that a codeword Xi is transmitted. We con- 
sider a receiver given by 

j2 , 



X 



arg mindiiV (X),T'(Y)). 
xeBx 



where P (X) e Gn,! (L) and V (Y) e Q,,,! (L) are planes 
generated by X and Y respectively. It can be verified that 

2 2 



1 + (T^ — e n^oo 1 + a-^ 

By similar argument to the proof of Theorem |2l if 



2e 



R. < lim 



f3 



log 1 



1 - 2e 



then Pr (x ^ Xi) = Pr {3j ^l,dl{V (X^) , P (Y)) < 
J 0. Finally, let e ^ 0. The achievable error- 



l+cr^-2e ) 

free rate for AWGN channel is then given by ^ log (l + 
which is the well known capacity of AWGN channel. 

Therefore, transmission in an AWGN channel is essentially 
communication on the Grassmann manifold: The decoder in 
the Grassmann manifold is asymptotically optimal. Further- 
more, based on the proof of Theorem |2l the capacity can be 
geometrically interpreted as sphere packing in the Grassmann 
manifold. 
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B. MIMO Communications with Beamfonning Matrix Selec- 
tion 

The Grassmann manifold also provides a useful analysis 
tool to MIMO communications with finite rate feedback on 
beamforming matrix selection. 

Consider a MIMO systems with Lt transmit antennas and 
Ln receive antennas (Ln < Lt is assumed). Suppose that 
the transmitter sends s (s < Lt) independent data streams 
to the receiver Let CJV {0, 1) denote the symmetric complex 
Gaussian distribution with zero mean and unit variance. Then 
the received signal Y e C-^"^^ is given by Y = HQX + W, 
where H G ^LrxLt jg (jjg Rayleigh fading channel state 
matrix with i.i.d. C7V(0, 1) entries, Q e C^^^" is the beam- 
forming matrix satisfying Q^Q = I, X e is the encoded 
Gaussian data source with zero mean and covariance matrix 
-I, and W e C'^^^^ is the additive Gaussian noise with i.i.d. 

s 

CN (0, 1) entries. In our feedback model, we assume that only 
the receiver knows channel state H perfectly. It will help the 
transmitter choose a beamforming matrix through a finite rate 
feedback up to i?fb bits/channel realization. Specifically, A 
codebook of Q, say Sq, satisfying |;Bq| = 2^"= is declared 
to both the transmitter and the receiver. Given a channel 
realization, the receiver selects a Q in Sq and feeds the 
corresponding index back to the transmitter 

The Grassmann manifold is related to throughput analysis 
of the above system. Let H — UAV^ be the singular value 
decomposition of H whereV e c^rxLj, satisfies V^V — I. 
We consider a suboptimal feedback function: for a given H, 
the selected beamforming matrix Q e Sq is given by 

Q = arg mind2 (p(V),7'(Q)) 

where V (V) G Gl^^l^ (C) and V (Q) € Gl^^^ (C) are 
planes generated by V and Q respectively. Then the expected 
throughput I is upper bounded by 



log 



1+ ^HQQ^Ht 



< Lr ■ log (^1 + ^^Ev [tr (VtQQtv)] j . (11) 

It is well known that the matrix V is isotropically distributed. 
Hence, 

Ev [tr (VtQQtv)] = min {s, Lr) - D (Bq) , 

where Bq — {V (Q) : Q G Sq} is the codebook generated 
from Sq. Based on the distortion rate bounds (|8j, the bound 
(fTTT i can be quantified for a given feedback rate i?fb. 

It is noteworthy that beamforming matrix selection is es- 
sentially unequal dimensional quantization when s ^ Lr. 
Similar models, with minor modifications, have been adopted 
and explored in many papers. The s — Lr — 1 case has 
been studied in [4], [5], [7], while [6] discussed a more 
general equal dimensional quantization where s > 1. Recently, 
unequal dimensional quantization (s = 1, Lr > 1) received 
attention for multi-user MIMO communications in [8]. Our 
model can be viewed as a generalization of all these works. 



VI. Conclusion 

This paper considers unequal dimensional quantization on 
the Grassmann manifold. An explicit volume formula for 
small balls is derived and then the rate distortion tradeoff is 
accurately characterized. The random codes are proved to be 
asymptotically optimal with probability one. As applications 
of the derived results, a geometric model for the capacity of 
AWGN channel is developed, and the effect of beamforming 
matrix selection in MIMO systems is discussed. 
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